According to Hyperbolic (@hyperbolic_labs), LLoCO on NVIDIA H100 delivered up to 7.62x faster inference on 128k-token sequences and 11.52x higher throughput during finetuning, and enabled processing of 128k tokens on a single H100 (source: Hyperbolic on X, Aug 21, 2025). For trading context, these stated gains are concrete performance datapoints for assessing throughput per H100 in long-context LLM workloads and may inform evaluation of AI compute efficiency tied to H100 deployments (source: Hyperbolic on X, Aug 21, 2025).

According to Hyperbolic, LLoCO delivered up to 7.62x faster inference on 128k-token sequences on Nvidia H100 GPUs, based on their reported results; source: Hyperbolic @hyperbolic_labs, Aug 20, 2025. According to Hyperbolic, LLoCO achieved 11.52x higher throughput during finetuning on H100; source: Hyperbolic @hyperbolic_labs, Aug 20, 2025. According to Hyperbolic, LLoCO enabled processing of 128k tokens on a single H100; source: Hyperbolic @hyperbolic_labs, Aug 20, 2025.